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^ The  purpose  of  this  paper  is  to  clarify  the  relationship 
between  three  different  criteria  for  optimization  of  acoustic 
signal  detection,  specifically,  the  maximisation  of 
array  gain  , the  minimization  of  signal  distortion,  and  the 
evaluation  of  the  Ncyiaan- Pearson  likelihood  ratio  are  shown  to 
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yield  equivalent  results  at  a single  frequency. 
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1.  INTRODUCTION 


9^  There  are  several  criteria  for  optimisation  of  a processor  for  an 

arrays  Of J sensors.  J.J.  Karan  and  R.  Hills,Jr.  have  used  the  criterion 


f — J £ 
U-  u 


I / ♦» 

O tv  ff>  2 

'a*  —»/  71 
r c*  •/  -h 

p V 

c / r/p 

/ o £* 

fn  jr.  a 

bo  o /’~j  *-* 

Vi  / 

«y  tj  *> 

^ V u>  o cl 
o £ u 
a Jj  n o 
81/  «C  y 

8>/C>  O w 
l +*  fi  ■"*  > 
g 

r Jp  t v w 
L/ fxiL  ** 

••o  c»/  o > 

H £ rt 

c •••  o 

«r4  ///-»•■» 

A <//o-  o o 

O Jbl  ~ J3 

d/  m »» 

• o/T7  © sm 
i aJH  *«  © u 
c$  u o 


of  maximization  of  array  gain 

* M J 7 n Am  A AMO  ^ V lo  nrf 


to  design  real  weightings  for 


individual  sensors.  N,  wiener  used  the  criterion  of  minimizing  sigtial 

2 

distortion  to  design  filters.  Other  authors,  notably  F.  Bryn,  have 
used  evaluation  of  the  Neyman- Pearson  likelihood  ratio  to  minimise  risk.^ 

This  paper  examines  the  relationship,  at  a single  frequency,  between  these 
three  criteria.  The  filters  required  by  each  of  the  three  developments 
are  shown  to  be  exactly  the  same  for  single  frequency  considerations. 

\j.j.  F&ran  and  K.  Hills,  ".vide- Band  Directivity  of  Receiving  Arrays," 

Harvard  Univ.  Acoust.  Kes.  Lab.  Tech.  Mem.  31  il  May  1953) 

^N.  Wiener,  Extrapolation . Interpolation . and  smoothing-  of  stationary 
Time  dories,  i>iIT  Dress  c-  .viiey,  .march  1949) 

3f,  Bryn,  "Optimum  digital  Processing  of  Three-Dimensional  Arrays  Operating 
on  Gaussian  signals  and  Noise,"  J.  Acoust.  doc.  Am.  34^  239-297  il9b2) 
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2.  FOiOt  OF  CAIN  EQUATION 

Let  «s  assume  that  we  have  K hydrophones  in  a sonar  array.  These 
hydrophones  have  output  waveforms  ^j.(t),  ir  aiince  we  may  be 

interested  in  spectral  . components,  we  shall  allow  these  waveforms 
to  be  complex.  Let  ZL,  i=  1,2,...,K  denote  the  (complex}  weight  functions 
which  then's  are  to  le  multiplied  by  before  summing  and  squaring.  The 
average  power  output  over  a time  interval  between  -1  and  T is 
T K K 


u/21’}  r ^ -j*ou)3  ^ 

* (1/21/  J~{-£  £,  ij'i.Vuz.MtlJ  Jt 
-I  i*l  j*l  J J x 

£ -i*-j  (1/2 ^ t ) dt  . 
i*l  j-1  -T 

Let  s^Ct)  denote  the  signal  component  of  -^lt},  and  n^t}  denote  the 
noise  component  of  ^(tj.  Thus  ^(W  = n^t)  + s^t}  . The  output  signal-  ' 
to-noise  ratio  of  the  array  is  defined  to  be  the  limit  of  the  ratio  of 
the  difference  between  the  average  power  output  when  signal  is  present 
and  when  signal  is  absent  to  the  average  power  output  when  signal  is  absent, 
X • c • 

K K • T 

A = lim(  [ £ £ U/2T}  f CsAtHn^urtsatHnAttf  dt 

T-~C  i'l  j*l  J -I 

K K T 

— ^ ^ Z.  (l/2Tj (t)  nAt)  dt  J / jn  tr 
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t = ' ^ ^ *i*zj  U/2TJ%/’fsi*U)SjU)+ s^On^tj+n^  (t)sj(t)}dtj/ 

iA  A.  2^j  a/2T>j"'Ma  juMt}  j 

/K  K « /-  T T * 

“ H Zj  £ 0/2T)  Si  It)  SjU)dt  t-  lira  U/2XJ  J~ si  (t)nj(t)d 

*»-  lim  (l/2T)  J~  nj*(t)s  At)dt^  ?/ 

T -**o  _t  J * J 

^ k k,  -•;%  li«  U/2T)  J n *(t)n.U)dti 

Li«i  j,i  A J T**o*>  rf  1 J ^ 


K K 


K K 


Assumption  rfl:  l'hc  signal  and  noise  waveforms  are  uncorrelatcd,  i.e., 

T T 

0 ” lim  U/2TJ  J si*(tjn  AtJdt  * lim  U/2TJ  f n ^UjsAtjdt  for  all 

l->-o  _t  J T->-°  -l  1 J 

1 and  j. 

Then  if  vc  let 

• T 

= lim  U/2T)^*  sAtJs  .(.t)  dt  j:  ! 

J _r  1 • J 

T > 

and  4?  lim  U/2I)  f n.  (t)  n,(t)  dt,  ' 

' J T-»*o  -T  1 J 


we  can  write  A as 


A r & ^eJ  ^ j4i  $ • 

Let  6 denote  the  signal  power  present  in  a standard  hydrophone  and 
N denote  the  noise  power  present  in  the  same  hydrophone.  The  array  gain 
is  defined  to  be  the  signal-to-noise  ratio  of  the  array  divided  by  the 
signal-to-noise  ratio  of  the  standard  hydrophone,  i.e., 


0 = VU/.-O  :gk  -i‘  ‘J0ijj  / 1 k k -i*  i*A » 


K X 
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Let  Pij  =©ijA  and  • 7111,5 


K K 


K K 


£ ^ 2i*ZjPij  / ^ Zi  2j  OiJ 

i-1  j-i  1 J AJ  i*l  j»l  1 J.  . 


To  simplify  this  notation  further,  let 


21  PH  Pi  2 •••  PlK  <Ji-i  9i2'*“  k 

2 = l2  > P = P21  P22  P2K  ' andQ=  q^  q22  qjjft 


P<1  pi\2  •“  PK’K 


9K1  *lK 2 •••  ^KK 


Note  tliat  P and  Q are  correlation  matrices  and  thus  are  positive  definite 
hcrinitian.  h'e  can  now  write 
G = Z*TPZ  / Z*TviZ 

Frequently  the  noise  and  signal  fields  are  assumed  to  be  homogeneous, 
i.e.,  the  same  noise  power1  and  signal  power  arc  observed  by  all  hydrophones. 
Then  if  the  standard  hydrophone  is  an  element  of  the  array,  this  implies 
•that  p. q..-  1.  This  assumption  is  not  needed,  however,  in  the  present 

\ii 


development. 


3.  MAXIMIZATION  OF  GAIN 


To"optimize"  our  system,  we  shall  choose  the  vector  Z which,  for 
given  P and  0,  will  maximize  C. 
dG*£(Z*T02)dU*TP£>  - (Z*TPZ)4U*T0Zj }/  (z*Toz)2 
= { iZ*T0z>  [z*7Pdz+U2)*TPz]  -U*rP^[2*r^dZ4^dZJ#Tvi2j  3/  U*T0Z)2 
C will  have  an  extremal  value  only  where  dC  = 0 for  all  choices  of  d-, 
hence  the  numerator  must  be  zero  for  all  choices  of  dl. 

$U*WTP  -(Z#TPZlZ*Tsl^  dz  4 (dZj*T  - (z*tpzkz}  s 0* 

(dZ)T  £(z*Tgz)p*Tz  ^(z*tpz)q*tz y 4 (dz!T(u*Tjz;Pi  - (z*tpz)oz}»  0. 

Since  P and  4 are  hennitian 

(dz)T£  i=*tqz;P2  - (z*tpz)  $:}*  = (dz)*T^z*^zjpz  - (z*tpz)qz)  . 
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The  only  way  this  can  be  true  for  all  possible  choices  of  dZ  is  for 
the  quantity  in  braces  to  be  the  icro  vector,  i.c., 

(Z^QZjPZ  = (Z*TPZ)vJZ  , 
or  PZ  = {(Z*TPZ)  / (Z*Ti)Zj}  QZ  . 

Assumption  //2:  The  matrix  d is  nonsingular. 

Q-ipz  = {(z*tpz)  /(z*Tdz;}  Z . 

Let  G0  = (Z^PZJAZ'^Z).  Then  vj~*P  Z = G0Z,  i.e.,  the  opl'mum  gain, 
Gq,  is  the  largest  eigenvalue  of  the  matrix  Q“^P  and  the  set  of  filter 
weights  which  produce  this  gain  form  the  corresponding  eigenvector. 

Clearly,  for  large  K,  a precise  investigation  of  the  general  nature 
of  G0  is  not  possible.  However,  by  proper  choice  of  P we  can  simplify 
the  problem  considerably. 

Assumption  ff3:  The  signal  field  is  produced  by  a monochromatic  wave- 
front  moving  across  the  hydrophone  array. 

Then  s^it)  = S a ^ , where  ^ is  the  time  for  the  wave- 

front  to  reach  the  i^  hydrophone  from  some  arbitrary  point  in  space. 


p.  .=  lim  (sA^/ZTo)  r dt 

J z~r 

= lim  $/2l'z)  S'  dt 

T-**o  J Z\ 

= (sA.^/S)  lim  U/2T>  C dt 

--  (sA>)  r°  r 

Let  c s Define  '■  r^i  . Thei 


t\>h 

U. 


Then  P = V V*T. 
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This  implies  that  P is  of  rank  1,  and  hence  vT1!’  is  of  rank  1. 
lluis  ^ "^P  has  only  one  nonzero  eigenvalue  which  must  be  0 . Further, 
we  can  sec  that/_Z  «=  KV  and  G0  = V^KV  , for 


(RP) (KV) 

yik  VV*T  KV 

„ *T 
VV  kV 

VV#1KV 


(V*TKVKKV) 

(V  *KV)  ^.V 

(V*TkV)  V 
*T 

VV  KV 


i 

In  this  way  we  can  arrive  at  the  transfer  functions  of  a set 
of  filters  which  will  give  the  greatest  possible  array  gain  at  each 
frequency  under  the  four  assumptions  given  above.  This  will  be  done 
by  repeating  the  process  for  each  frequency  of  concern,  to  get  a 


vector  Z{f)t  where  Hf) 


W) 

*2(0 


Then  the  desired  system  is 


This  analysis,  however,  says  nothing  about  the  relative  weighting 
of  the  frequencies,  since  any  multiple  of  these  filters  will  produce 
the  same  signal- to-noise  ratio  in  the  output.  Thus,  a frequency  weighting 
filter  is  also  desired  at  the  output. 

K.  Bryn  indicates  that  a desirable  filter  is  the  Kckart  filter,*. 

• * _ . i • 

, l The  transfer 

function  of  this  filter  is  )/%({) , whereof)  and^if;  are  the 
signal  and  noise  power,  respectively,  at  the  summed  output  of  the  Z> s . 
Note  that 

I 

Ju)  = su)  z*T{f)  n f)  2(f) 

= Hf){Mf)  V(f)>*T  i\f){u(f)fiO) 

• = 6(f)  V%f)  R(f)  V(f)  R{ f)  Hn 

= 6(f)  Co2if), 

and  %()  = N ( f ) Z*T(f)  dif)  2(f) 

= N(f){K(f)VU)}<>1  Q(f)(iv(f)V’(f)} 

= N(f ) V*l\f)  K(f)  4(f)  KU)  *\f) 

* N(f ) V*TU)  K(f)  V(f) 

= N(f)  Co(f)  . 

Thus  (^(O/^if)  ) = ( G02(f)  S(f)/  Co2(f)  N2(f)  ) = i(f)/N2(f)  . 

However,  as  will  be  seen  later,  it  appears  that  a better  system  for 
detection  nay  be  ^2(f)/£^2(f)  ( )+^f)  . N'ote  that  this 

could  also  be  written  as 

jhf )/{%[)  U+£JU )/7/u\Q)*}  * Af)/Js(f)  (1+ lS(f)/N(f)30tf))ij. 

*C.  Eckart,  SIC  Kef.  52-11,  University  of  California,  hariqe  Physical 
Laboratory,  dcripps  institution  of  0ccanography(1952). 
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. The  system  could  then  be  represented  as 


4.  F.  BRYN'S  A Pi’KOACH 
F.  Bryn  views  the  basic  problem  as  deciding  the  answer  to  the  question, 
"Were.-  these  jk' s produced  by  random  variation  in  a noise  field,  or  by  the 

t A 

\ 

sum  of  a signal  and  random  variations  in  the  noise  field?" 

To  answer  this  question,  Bryn  considers  each  frequency  separately.  Me 
shall  use  the  notation  in  the  previous  sections  to  abridge  Bryn's  derivation 
and  avoid  a small  signal  assumption.  Let  us  assume  that  then's  arc  observed 
over  a time  interval  0 to  T and  have  no  frequency  components  above  fy.  Then 

we  can  represent  /.  as 

1 f,T  j2tfht/T 

/*(t)  = xiin)  e 

n=  -fyT 

Then  all  of  the  available  information  is  contained  in  a set  of  vectors 

X(n)  = | x1(n) 

X2in> 

• • • 

• • • 

xku; 

Assumption  la:  The  components  of  then's  at  different  frequencies  are 
statistically  independent.  * 

This  means  that  the  probability  of  a particular  Xln>  is  not  affected 
by  any  X(nJ,  n /lm. 

Let  siit)  denote  a hypothetical  signal  component  of  the  output  from 
the  ic  hydrophone.  We  shall  decompose  s^  as 

fuT 


,(.)  --  £ aw  eJ2*,t/T 

0=- 1 1 ■ T 
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and  define  Y(n,/  =F  y^inj  . The  Y(nj's  will  be  assumed  statistically 

yjU) 


independent  also. 


yK(«) 


We  must  now  choose  between  two  hypotheses: 

a;  The  vectors  X(n),  n «•  — f jjT,  . . . , f^T  were  produced  by  tlie  random 
noise  field. 

B)  The  vectors  X(n),  n = -f^T, . . . ,fjjT  were  produced  by  a combination 

\ 

of  signal  field  and  noise  field. 

Let  denote  the  probability  density  function  of  X when  only  noise 

is  present,  and  F^(X,n)  the  probability  density  function  of  X when  signal 
plus  noise  is  present.  Since  X^nJ  - X*j.-n),  we  shall  use  n=  1,2, ...,fyT 
for  our  testing. 

It  can  be  shown  from  game  theory  that  the  best  criterion  to  use  on 
X to  decide  whether  a signal  is  present  is  the  Ncywan-Pearson  likelihood 
ratio, ^ 

f,  T f T 

LR=  v ( m FN(x»n> ) • 

n*l  h=l 

Assumption  2a:  The  X^nJ's  are  sampled  from  a random  process  which  is 
stationary  and  ergodic. 

t 

Assumption  3a:  The  x^(n)'s  indicate  an  equal  distribution  of  power 
between  their  real  and  imaginary  components,  i.e., 

^Retx^n))-}  ^ }2>  > 

where ^ ^ denotes  an  ensemble  average,  whether  the  ensemble  is  over 
signal  plus  noise  or  over  noise  only. 

5W. B.  Davenport  and  w. L.  Root,  An  Introduction  to  the  Theory  of  Random 
Signals  and  Noise., (McGraw-Hill  Rook  company,  Inc.,  New  fork,  1933^  Chap.  14. 
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Assumption  4a:  The  X(n) ' s have  Gaussian  distributions  in  either  the 
signal  plus  noise  case  or  in  the  noise  only  case.  In  other  words,  both 
noise  and  signal  fields  are  assumed  to  be  Gaussian  noise  sources. 

Under  the  ergodic  assumption  the  matrix  *3  in  the  third  section  is 
related  to  this  section  by 


So 


0 In;  = /in;  = (^x^x*1^;^  $ U/N)  . 


>-(l/N)  X*T(n)v}*-1(n)  X(n) 


F^(X,n)  - const  e* 

U:ider  the  signal  assumptions  in  the  third  section  we  can  form  the 
correlation  matrix  for  the  signal  plus  noise  situation  by  using  the 
X(n)'s  from  the  noise  field  and  adding  vectors  T(n). 

^£Xln) * ’fin)}  £xin)fYln)^  ^ =/Xln)X*TUn))^+^tln;lf  Tln;^ 
: N'ln)  /in)  -f  SlnJ  P*\n) 

Ihus 

LK  = (const  yr  « <iu;+sm;p*ln)>“1  Mn)  \ 

fconst-^j1  /whwn-'J'hw  > 

n 1 * 

=£const  tyf-*  e-x*TU;{*Hn;/lnHolnjV*(n)VT(ftiJ~1  ) / 

C n 1 ^ 


x(n) 


h*l 


i 


Kecalling  from  matrix  algebra  that 

(n/+s/vt)  “1-  ii/.\)vi*"1-(is/.N2>Uft“1vfrnvT/"1)J/|l  <-is/x)vV"Vj 

we  can  simplify  the  expression  for  LR.  (This  equation  is  a special 
case  of  (A-flV1)"1  = A”^  /ll*-VTA“lbjJr,  where  a is  a 

square  matrix,  U and  V are  column  vectors,  and  A and  (A+l'V  ) are 


assumed  nonsingular.  This  equation  is  readily  verified  by 
l.VW  V 1 ) (a-1-  U/1+  V 1 A'1U ) U^U ) ( vta-i  ;} 

= I - tl/l+vV:1l)*UVTA*‘1-t-  UV^r1  -(l/l+vViuj^U^V  A XU;  V A-1} 
= iv-uv^r1  - (i/i+v^a-1^;  { uv’a-I  + ^vta“1ukI'V'1a“1;J 

= 1+  UvV-1  - U/l+VTA-1b)  {.UvV"1  U4'Vla“1U<|} 

- I J Using  this  expression  and  assuming  j and  Nd  +6V  V to  be 


nonsingular, 


Slnj/X?;inJ  Jd>~-l-injy*injVTln)dVf~1(n 


Ll{r  st  v *h«)  - ' 

V.  n*d 

. W -x*Tu)  /_1U1  xuA 

r,5^f  T jSjn)/N2(n,);  • ^ ^Wl^AiO  ^(njr.lnA 


r const  “77“  e 


1 '-(>i^n;/Ntn^v\n;d-“~1in.lVVin; 


LR  = Cu,  e 


*T  *_i  . i *_i 


whorp  n j - ii Hi  X jnld  ^(njV^njVjnJd  /jnjXjnj 

where  Hn)  - “7^.  “ . . /.  . .,7. 


vnere  ''V**/  - o , 1 ^-TT  .*  • 

N2inJ  1 •*“  iitnl/Ninll  V inld*  \nj  V ini 

To  see  bow  a filter  set  can  develop  W(nl,  we  can  re-write  this  as 


.•  . S(n)  \*Tinj  id~^inlVjnJ  1*  jyTtnl  d^jnljXjnJ 


1-h  Uinl/Nim )V  inlw  iniV  ini 

*1jn J V ( n ) )<T  X*(n)  XT(n ) id*1-1* n)Vinl 1 


S (nl  1+  Uini/N(nll  V in,  1 ~Ai 
:>(nl  id*'1injVinll*T-t*in)  XTinlid 


N2ln)  l + id(nl/Ninll  V^lnld'HnJ  VU1 

*1,  . i 

Recall  from  the  third  section  that  Goinl  = V (nld“Aini Vinl,  and 
Zgin)  = d~*(n)  V(nl,  so 

*(n)  = i$ln)/N2(n))  (1/1+  (Sin)/N(nllC  In)  ) Z*T(n)X*{n)ZT(n)Z^n) 
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This  can  also  be  written  as 

Whi)  = ( <U»0/72-(n)  + Jtnjy  ) Z^UA^njX^nJa^nJ  • 

A detection  is  said  to  occur  when  the  likelihood  ratio  exceeds  a certain 

f T 

value, ^ . This  is  equivalent  to  saying  that  W(n J exceeds  the  log 

n-1 

of  ,/>/  C The  desired  filter  systc  1 is 


5.  OBSERVATION'S 

The  reader  will  note  the  similarity  between  the  transfer  function 
d'2'L n)/P22(n)£%n)*}Ji.n))-~2  and  the  Lekart  filter */^(n)/^(nj  . This 

development,  however,  did  not  require  the  use  of  a small  signal  approx- 
imation. The  filters  ZQ  remain  the  same  as  those  developed  in  the  third 
*\  section.  Thus  we  have  shown  that  at  one  frequency  the  problem  of  evaluating 

the  Neyman- Pearson  likelihood  ratio  is  equivalent  to  the  problem  of 
maximizing  the  signal-to-noisc  ratio  at  the  output  of  a set  of  linear  filters. 

A word  of  caution  is  in  order  concerning  the  assumption  of  an  infinite 
integration  time.  This  assumption  is  implicit  in  the  assumption  that  the 
frequency  components  are  statistically  independent.  Thus  this  development 
must  be  used  with  caution  unless  long  integration  times  arc  used. 

6.  N.  .rtENEH'o  APPROACH 

The  approach  of  a'icner  is  to  minimise  the  distortion-of  the  signal. 

ife  shall  consider  a single  frequency  first.  >iorc  precisely,  if  the 

Jr 

filter  weights  are  Z. , and  the  output  is  2^  and  s(tj  is  the 

i*l 


L 
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signal  at  some  point  in  space,  the  distortion  or  error  in  the  output 
of  the  filters  is  defined  as 

K - lira  U/2r)v/{  sltj-g  zi  AU)J  £s^“ &h  dt 

T-*jo  -T  v i=l  i-1 

V K T , 

= lim  U/2T)  f s ( t J s'  ( t ) d t -X  -1-  lira  U/2T)  J~  s(t;.*  (t)dt 
T-»«s  -i’  1^1  T->=o  -T 

K T 

T lira  U/2TJv/'s  It^i1'  " 

i=l  T->~*  -T 

K I\  # T 

+ ^ ^ zi  z-j  lira  U/2T) J iVUltj  dt  . 
i»l  j=l  J T *><«  -f  1 J 

The  assumption  that  signal  and  noise  are  uncorrelatcd  implies  that 

lim  (l/21’)  C s(tl  j?-  \t)dt  : Se^^^i  . 

T->«=  ~£  x 

oince  signal  is  now  present  along  with  the  noise, 

T ' 

lira  U/2TJ  T ^.'lt)je.(t)  dt  *=  O .+  O , . 

1 -><*=>  ti’  1 J XJ . 7 J 

In  the  previous  notation,  then,  we  can  write 
T 

E - lim  U/2T)  j s(t;s*it;dt  -SZ*TV-iV*TZ-t-Z*TtoPVNQjZ  . 
t-^  - r 

In  wiener's  formulation,  the  optimum  Z'  s are  those  which  give  the  minimum 
L.  To  find  them 

dh  = -b(dZ)*TV  - bViTUZ)+idZ>*f  idP+Xj)  Z + -*T(aP«wKdZ)  = 0 
ldZj*T  £\dP+.N 4)Zj  - oVj  Z./\oPKVi)  - ov*t3  id-;  = 0 . 
or  Ke  { (dZ;*r£voP«.l)'Zrf  - oVj ] - 0. 

The  only  way  tha t this  can  be  true  for  all  possible  dZ  is 
(6P+SQ)Z  . = 6V 

= (3PfNQ)“1oV  . 

Recall  that  P = VV*T,  so 

2W  r (N^dv/’V1  dV 

= ^U/NN"1  -Ud/N2)U/i*-iVN;v*V1v;Jvt‘1v  v*V^  dV 
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or  ..I,.  - £u/N)«  - IS/N2)U/1+ IS/N)  V*lKV  ) KV  V^R^SV 

- = »*  | « *(«y  (i  + i^Mv’-'nv)  v*IR'j 


Recall  that  C = V*TKV,  so 


%■  = rv^“n  ~ H2)  (tt’8o  ^,/nj) 


Since  Z . is  a multiple  of  ZQ,  the  array  gain  of  the  wiener  filters  is 

<2r 


z»‘ = zo  [ s 

7 ( SN+  S,2c:  ~ ^2°n) 
■ Zol  »H.N  k>G07  j 


“ "o  (S/^+SGq) 

= 20(sA)(1/1^  IS/X)Co  ) 

= 20  U/G0)  J 

= -o(l/C0)^^)  . 

The  system  indicated  hy  this  development  would  be 


2nll 

l "°2| — 

• # • 

M i) 

U/0o)  ? JuW'.o 

Q~,  ~°v. 

l 
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APPKNDIX  1.  GAUSSIAN  DISTRIBUTION 
OF  COMf’LluX  VAKIlBLbi 

The  purpose  here  is  to  develop  the  form  which  a multivariable 
Gaussian  distribution  of  complex  variables  must  take.  To  do  this, 
consider  a complex  random  variable  x = a+ib,  where  a and  b arc  real 
numbers.  Ac  shall  assume  that  a and  b are  Gaussian  random  variables 
with  zero  mean,  i.e.,  if  <>  denotes  the  ensemble  average,  <a>  - ^b>  = 0. 
The  probability  distribution  functions  for  a and  b,  respectively,  are 

P(a)  = (l/^aJ2?rO  e"  a /2  a and  P(b)  - U c , 
where  0^2-(a^  , and  -Co2^  • 

We  shall  make  two  more  assumptions  about  a and  b: 

1.  a and  b are  statistically  uncorrelated,  i.e.  ^ab>  = 0. 

2.  a and  b have  the  same  variance,  i.e.. 

We  shall  define 

<x*x>  = <a2+b2>=  <a2>^2>  = cra2f-  cr02  . 

Under  these  asunptions  we  can  write  ?vxj  as 

P(x)  = Pia^P^b)  = U/O^'fo  e“(a2+b2)/c^2  = U//?<£2)  . 

Now  let  Xp  X2, ...,x^  denote  K independent  complex  variables, i. e. , 


^x.xj*)  = 0 if  i f j,  and^x^xj^=  0 Vi,j.  Let  X = 


write  P(X)  as 


' TT o'"2  ) . Pi  1 1 

i-1 


X1 

x2 
• • • 

• • • 

Xx 

v * J 


Then  we  can 


pu)  = a/ip 

2 45* 

where £3^  =<xixi  > 

This  can  be  simplified  by  defining  tlic  .vxa  matrices 


— n 

3 

to 

0 

1 

...  0 

, and  P«x  » - 

ri  bV- 

0 ...  0 

0 

• • • 

0 0 

...  0 

•**  A 

0 

• • • 

0 

Ur*2--  0 

0 ...  ifif 
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J’hcn  wo  can  write  l’(X)  as 

PUJ  = (l/^KJ>ix|  ) e-X#T“xX  . 

Now  consider  a second  set  of  random  variables,  y^,y2,  • • • >y^>  which 
arc  linear  combinations  of  the  • • • >xlV*  We  can  define  Y e [ y^  1 , 

y. 


and  write  Y - AX,  where  A is  a nonsingular  matrix  whose  dimension  is  ivxX. 

To  relate  the  ensemble  averages  \y.y-:  ^ to  the  x's,  we  shall  form  the 

i J 

square  matrix\YYv ^ . Note  that  the  ensemble  averages  in  question  are  the 
elements  of (YY*^ . but  -<Cyy A <\X  AJ^A  Thus 

we  can  define  dy  - K> YYV^>  - AdxAv^  , and  dy  will  always  be  positive  definite 
he  Haitian. 

We  are  now  in  a position  to  write  the  probability  density  function  of 
Y,  for  it  is  the  probability  density  function  of  the  corresponding  X,i.e., 

P(x)  : (N/O*  !jx|  ) lf)  R*U  1,f 

: Mif  k| ) «'1'1  * 

where  N is  a normalizing  factor  to  assure  that  the  integral  of  P(()  over 
all  y^  equals  1. 

—1  *T  —1  •»! 

Then  we  can  define  l A ) U^A  noting  that  dy  . We  can  now 


write 


PCY)  = (.V /fit  |Qj  ) e'^N*  . 

lhus  wo  can  expect  that  under  assumptions  1 and  2,  the  Caussian  distribution 
for  complex  variables  should  take  the  form  of  a constant  times  e to  a 
-quadratic  form  in  Y,  and  that  the  natrix  in  this  quadratic  form  will  be 
the  inverse  of  die  positive  definite  heroitian  matrix  ^Tt  ^ • Note  that 
the  argument  is  reversible  since  any  hermitian  matrix  can  be  diagonalized. 


